Abstract 


Despite wide achievement gaps across 
California between students from different 
racial and socioeconomic backgrounds, 
some school districts have excelled at 
supporting the learning of all their students. 
This analysis identifies these positive outlier 
districts—those in which students of color, 
as well as White students, consistently 
achieve at higher levels than students 

from similar racial/ethnic backgrounds 

and from families of similar income and 
education levels in most other districts. 
These results are predicted, in significant 
part, by the qualifications of districts’ 
teachers, as measured by their certification 
and experience. In particular, the proportion 
of underprepared teachers—those teaching 
on emergency permits, waivers, and intern 
credentials—is associated with decreased 
achievement for all students, while teaching 
experience is associated with increased 
achievement, especially for students of color. 


The full report can be found online at 
https://learningpolicyinstitute.org/product/ 
positive-outliers-districts-beating-odds. 
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California’s Positive Outliers: 
Districts Beating the Odds 


POSITIVE OUTLIERS SERIES 


Introduction 


To succeed in the 21st century, young people need to be able to think 
critically, collaborate effectively, communicate clearly, solve complex 
problems, and continue to learn independently throughout their lives. In 
order to equip the next generation of Californians with these skills, the 
state adopted new learning standards and assessments that require all 
students to engage in higher-order thinking and problem-solving. Around 
the same time, California implemented a new funding and accountability 
system, the Local Control Funding Formula, which allocated funds based 
on pupil needs and removed most categorical restrictions on spending. 


While these changes were motivated in part by the desire to improve the 
achievement of historically underserved students, statewide assessments 
show that achievement gaps in many districts continue to widen. Despite 
wide achievement gaps across the state between students from different 
racial and socioeconomic backgrounds,! some California school districts 
have excelled at supporting the learning of all students. 


We refer to these California school districts as “positive outliers” because 
their students are beating the odds. In these districts, students of color, 
as well as White students, consistently achieve at higher than expected 
levels, outperforming students of similar racial/ethnic backgrounds from 
families of similar income and education levels in most other California 
districts. Positive outlier districts appear to have leveraged the state’s 
updated educational standards, funding, and accountability systems to 
support students in meeting the more rigorous academic standards. 


We conducted an analysis to identify positive outlier districts. These 
results show, for the first time, which California districts and communities 
appear to have best supported the academic achievement of African 
American and Hispanic students, as well as White students, in the first 

3 years of the new assessments—the 2015-17 California Assessment 
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of Student Performance and Progress in mathematics and English language arts—controlling for the 
socioeconomic status of families in each district. We also examined some of the factors associated with their 
success. (See full report for a discussion of the methodology.) 


California’s Positive Outliers 


California districts vary significantly in terms of their students’ achievement. Figure 1 shows the variation in the 
achievement of African American, Hispanic, and White students across California’s 435 school districts with 

at least 200 African American or Hispanic students and 200 White students. African American, Hispanic, and 
White students in many districts achieve at higher than expected levels given the socioeconomic conditions for 
each of those groups in their communities. Observations in the top right quadrant of Figure 1 are considered 
positive outlier districts because White and African American/Hispanic students achieve at higher than 
predicted levels relative to their socioeconomic status. California has 156 districts of significant size in which 
students achieve at much higher than expected levels. In contrast, districts in the lower left quadrant are 
identified as underperforming because African American, Hispanic, and White students achieve lower than 
predicted by their socioeconomic status. 


Figure 1 


Student Achievement in California Districts 
Average African American/Hispanic and White achievement by district averaged across subjects, grades, 
and years (2015, 2016, and 2017) 


* Positive Outlier Districts 
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Underperforming Districts 45 
White students achieve lower than White students achieve higher than 
predicted based on their families' SES predicted based on their families' SES 


Notes: Figure includes districts with at least 200 African American or Hispanic students and 200 White students. The size of the marker is weighted by the number of African 
American and Hispanic students tested in the district. Achievement is measured by residuals in standard deviations. The origin (0,0) represents districts in which African 
American and Hispanic and White students perform as predicted based on the SES of each group’s families in the district. 

LPI analysis of data from California Department of Education. (n.d.). California Assessment of Student Performance and Progress (CAASPP) results. https://caaspp.cde.ca.gov 
(accessed 01/05/18); National Center for Education Statistics. (n.d.). Education demographic and geographic estimates. https://nces.ed.gov/programs/edge (accessed 
01/05/18). 
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We identified 48 districts of significant size in which both African American and White students achieve 

at higher than predicted levels. (See Figure 2.) We use the “residual” from a regression equation, which 
expresses the difference between the actual scores for each group of students and those predicted by their 
socioeconomic status. On our measure, Chula Vista Elementary District is the top district in which both White 
and African American students perform higher than predicted, with several other elementary districts right 
behind. San Diego Unified and Long Beach Unified are the largest districts in which both groups significantly 
outperform expectations. (See Figure 2 and Table 1.) 


Figure 2 


Districts With Higher Than Predicted African American and White Student Achievement 
Average African American and White residuals by district averaged across subjects, grades, and years 
(2015, 2016, and 2017) 
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Note: Size of marker is weighted by number of African American students tested in the district. 


Data sources: California Department of Education. (n.d.). California Assessment of Student Performance and Progress (CAASPP) results. https://caaspp.cde.ca.gov (accessed 
01/05/18); National Center for Education Statistics. (n.d.). Education demographic and geographic estimates. https://nces.ed.gov/programs/edge (accessed 01/05/18). 


Approximately 167 California districts have had Hispanic and White students consistently achieve at higher 
than predicted levels. (See Figure 3 and Table 2.) The small districts of Newhall, Winton, Little Lake Elementary, 
and Magnolia Elementary are highest performing for both groups. Hawthorne and Palo Verde Union Elementary 
are high-performing for Hispanics. Chula Vista makes the list once again, as do the larger districts of Long 
Beach and San Diego. 
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Figure 3 


Districts With Higher Than Predicted Hispanic and White Student Achievement 
Average Hispanic and White residuals by district averaged across subjects, grades, and years 
(2015, 2016, and 2017) 
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Notes: Size of marker is weighted by number of Hispanic students tested in the district. Due to space constraints, we only label districts with over 25,000 students or districts 
in which either Hispanic students or White students achieved at least 0.20 standard deviations higher than predicted. 


Data sources: California Department of Education. (n.d.). California Assessment of Student Performance and Progress (CAASPP) results. https://caaspp.cde.ca.gov (accessed 
01/05/18); National Center for Education Statistics. (n.d.). Education demographic and geographic estimates. https://nces.ed.gov/programs/edge (accessed 01/05/18). 


Predictors of Student Achievement 


Next, we examine the factors most strongly associated with the achievement of African American, Hispanic, and 
White students. After controlling for the socioeconomic status of students’ families and district characteristics 
(such as size and demographic composition) in our regression analysis, we find that teacher qualifications are 
the most important school-related predictors of student achievement. 


Most significant among these is the preparedness of teachers. We find that the percent of teachers holding 
substandard credentials is significantly and negatively associated with student achievement. In these districts, 
for every 10% increase in the percentage of teachers with permit, waiver, or intern credentials, the average 
achievement for students of color is lower, on average, by approximately 0.10 standard deviations. For White 
students, every 10% increase in the percentage of teachers teaching on substandard credentials is associated 
with decreasing their achievement by nearly .07 standard deviations. 
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In addition, teachers’ average experience level within a district is positively associated with achievement for 
African American and Hispanic students. Teachers’ salaries, which are typically associated with the quality of 
teachers recruited and retained, make a positive but not statistically significant difference in achievement. 


This finding reflects other research showing that teachers are often considered to be the most important within- 
school contributors to student achievement.” We recognize that qualities such as teacher preparation and 
experience are also associated with other variables that influence staff recruitment and retention and may signal 
broader differentials in teaching and learning conditions. For example, districts in rural areas with less proximity 

to schools of education and many amenities struggle to recruit and retain teachers, as do under-resourced 
communities, which often struggle as well to retain strong principals and provide sufficient teaching resources. 
These places that are difficult for teachers to work in and difficult for students to learn in may feel they need to hire 
more teachers on substandard credentials because relatively few teachers want to work in the district. 


It is also true that districts are differentially focused on recruiting and retaining staff, and that some spend more 
of their money and effort to recruit and retain a strong teaching staff than others.* Whatever the sources of 
substandard credentials, this finding highlights the importance of teacher characteristics as indicators of both the 
teaching and learning conditions within a district and as correlates of student achievement. 


We explore several other factors and generally find that they are not significantly associated with student 
achievement in our models when we control for district socioeconomic status and other district characteristics. 
District size does show a negative influence on achievement, even after controlling for Los Angeles Unified School 
District, the state’s largest district. Teacher-pupil ratios are not significantly associated with student achievement, 
after controlling for teacher qualifications. Similarly, after controlling for student-teacher ratios, teacher salary 
levels, and teacher qualifications, total school spending does not have a statistically significant association with 
student achievement. This is not surprising, as these variables capture the major elements of total expenditures. 
Other studies have found that increased district expenditures allocated toward instruction® and investments in 
teacher quality® can be especially effective at raising student achievement. 


Conclusion 


These analyses indicate that a substantial number of districts in California are outperforming expectations for their 
students’ achievement on the state’s new, more rigorous assessments, which more fully measure deeper learning. 
Aside from socioeconomic status of students, a major predictor of student achievement is the preparedness of 
teachers. Underprepared teachers—those teaching on emergency permits, waivers, and intern credentials—are 
associated with decreased achievement for all students, especially for students of color. 


This is a particularly important finding at this moment in California, where severe teacher shortages have created 

a large influx of underprepared teachers, which has dramatically increased since 2015. In 2017-18, the Teacher 
Credentialing Commission authorized more than 12,000 substandard permits and credentials, representing about 
half of the entering workforce in that year.’ These underprepared teachers are disproportionately assigned to 
schools serving the largest shares of students of color and students from low-income families throughout the state.® 


Districts that have been able to avoid the effects of widespread teacher shortages by recruiting and retaining fully 
prepared teachers are much more likely to produce strong student achievement for African American and Hispanic 
students as well as for White students. Our results highlight the importance of investing in preparing and keeping 
quality teachers. 
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Table 1 
List of Positive Outlier Districts for African American Students 


As Presented in Figure 2 


District Name (African American Student Residual, White Student Residual) 


OoOANOoOKRWNHPE 


NNNNBB BERBER BBB BB 
ONFRAOOANAaAKRWNHRO 


. Chula Vista Elementary (0.213, 0.233) 

. Perris Elementary (0.199, 0.048) 

. Etiwanda Elementary (0.180, 0.174) 

. Alvord Unified (0.173, 0.111) 

. Santa Monica-Malibu Unified (0.173, 0.018) 
. ABC Unified (0.170, 0.230) 

. Lemon Grove (0.167, 0.181) 

. Redlands Unified (0.163, 0.106) 

. San Diego Unified (0.160, 0.142) 

. San Marcos Unified (0.154, 0.200) 

. Greenfield Union (0.146, 0.110) 

. Lawndale Elementary (0.144, 0.192) 

. Hawthorne (0.142, 0.119) 

. Downey Unified (0.140, 0.093) 

. Long Beach Unified (0.119, 0.117) 

. San Bernardino City Unified (0.110, 0.092) 
. Tustin Unified (0.109, 0.008) 

. Upland Unified (0.106, 0.031) 

. Desert Sands Unified (0.106, 0.112) 

. Corona-Norco Unified (0.085, 0.059) 

. Culver City Unified (0.080, 0.087) 

. Visalia Unified (0.079, 0.115) 

. William S. Hart Union High (0.077, 0.075) 
24. 


Val Verde Unified (0.076, 0.167) 


25. 
26. 
27. 
28. 
29. 
30. 
31. 
32. 
33: 
34. 
35. 
36. 
37. 
38. 
39. 
AO. 
41. 
42. 
43. 
44. 
45. 
46. 
47. 
48. 


La Mesa-Spring Valley (0.075, 0.120) 
Center Joint Unified (0.071, 0.189) 
Bellflower Unified (0.059, 0.111) 

Twin Rivers Unified (0.058, 0.093) 
Merced City Elementary (0.055, 0.035) 
Sacramento City Unified (0.054, 0.064) 
Vista Unified (0.053, 0.075) 

Central Elementary (0.053, 0.083) 

Dry Creek Joint Elementary (0.043, 0.018) 
Riverside Unified (0.042, 0.048) 
Torrance Unified (0.042, 0.003) 

Palm Springs Unified (0.038, 0.009) 
Bakersfield City (0.033, 0.081) 

Apple Valley Unified (0.029, 0.022) 
Fremont Unified (0.029, 0.032) 
Oceanside Unified (0.029, 0.100) 
Grossmont Union High (0.027, 0.012) 
Elk Grove Unified (0.020, 0.107) 
Anaheim Union High (0.017, 0.003) 
Brentwood Union Elementary (0.017, 0.005) 
Murrieta Valley Unified (0.013, 0.035) 
Cucamonga Elementary (0.008, 0.001) 
Fresno Unified (0.005, 0.034) 

Alta Loma Elementary (0.002, 0.071) 


Data sources: California Department of Education. (n.d.). California Assessment of Student Performance and Progress (CAASPP) results. 
https://caaspp.cde.ca.gov (accessed 01/05/18); National Center for Education Statistics. (n.d.). Education demographic and geographic estimates. 
https://nces.ed.gov/ programs/edge (accessed 01/05/18). 


Table 2 
List of Positive Outlier Districts for Hispanic Students 


As Presented in Figure 3 


District Name (Hispanic Student Residual, White Student Residual) 


1. Newhall (0.354, 0.300) 14. Lawndale Elementary (0.236, 0.192) 

2. Hawthorne (0.326, 0.119) 15. Sulphur Springs Union (0.233, 0.234) 

3. Winton (0.310, 0.384) 16. Holtville Unified (0.228, 0.122) 

4. Palo Verde Union Elementary (0.307, 0.061) 17. Los Alamitos Unified (0.223, 0.179) 

5. La Canada Unified (0.298, 0.084) 18. Solana Beach Elementary (0.221, 0.058) 

6. Little Lake City Elementary (0.286, 0.274) 19. ABC Unified (0.220, 0.230) 

7. Coast Unified (0.283, 0.070) 20. Atwater Elementary (0.218, 0.243) 

8. Magnolia Elementary (0.280, 0.354) 21. Sanger Unified (0.214, 0.257) 

9. Carmel Unified (0.271, 0.182) 22. Kingsburg Elementary Charter (0.213, 0.050) 
10. Gridley Unified (0.255, 0.122) 23. Wright Elementary (0.212, 0.032) 
11. Solvang Elementary (0.254, 0.131) 24. Chula Vista Elementary (0.204, 0.233) 
12. Clovis Unified (0.249, 0.180) 25. Sundale Union Elementary (0.203, 0.334) 
13. Kings Canyon Joint Unified (0.240, 0.163) 26. Caruthers Unified (0.197, 0.093) 
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District Name (Hispanic Student Residual, White Student Residual) 


27. 
28. 
29. 
30. 
oH ie 
32. 
33. 
34. 
35: 
36. 
37. 
38. 
39. 
40. 
41. 
42. 
43. 
44. 
45. 
46. 
47. 
48. 
49. 
50. 
51. 
52. 
53. 
54. 
55. 
56. 
57. 
58. 
59. 
60. 
61. 
62. 
63. 
64. 
65. 
66. 
67. 
68. 
69. 
70. 
TA. 
72. 
73. 
TA. 
LD: 
76. 
TT. 
78. 
79: 
80. 
81. 


Bassett Unified (0.196, 0.073) 

Downey Unified (0.195, 0.093) 

Nuview Union (0.194, 0.141) 

Kerman Unified (0.191, 0.177) 

Fallbrook Union Elementary (0.190, 0.291) 
Placentia-Yorba Linda Unified (0.184, 0.115) 
Live Oak Unified (0.183, 0.190) 

Encinitas Union Elementary (0.181, 0.048) 
Rocklin Unified (0.175, 0.083) 

Etiwanda Elementary (0.174, 0.174) 

East Whittier City Elementary (0.173, 0.146) 
Greenfield Union (0.167, 0.110) 

Val Verde Unified (0.166, 0.167) 

Del Mar Union Elementary (0.166, 0.123) 
Centralia Elementary (0.165, 0.262) 

North County Joint Union Elementary (0.164, 0.141) 
South Bay Union (0.157, 0.225) 

Duarte Unified (0.157, 0.031) 

Mother Lode Union Elementary (0.157, 0.053) 
Carlsbad Unified (0.157, 0.148) 

Riverdale Joint Unified (0.156, 0.007) 

Perris Elementary (0.154, 0.048) 

McCabe Union Elementary (0.153, 0.117) 
Firebaugh-Las Deltas Unified (0.150, 0.016) 
Ocean View (0.149, 0.092) 

Delhi Unified (0.148, 0.084) 

San Marcos Unified (0.148, 0.200) 

West Covina Unified (0.147, 0.154) 

Mesa Union Elementary (0.145, 0.041) 
Central Union High (0.142, 0.003) 

Hanford Elementary (0.141, 0.221) 

EI Monte City (0.139, 0.398) 

Antelope Valley Union High (0.138, 0.069) 
Fruitvale Elementary (0.137, 0.132) 
Carpinteria Unified (0.133, 0.060) 
Bellflower Unified (0.132, 0.111) 

Saint Helena Unified (0.131, 0.053) 

Weaver Union (0.129, 0.100) 

Whittier Union High (0.128, 0.157) 
Redlands Unified (0.124, 0.106) 

National Elementary (0.122, 0.198) 
Monrovia Unified (0.122, 0.161) 

Glendora Unified (0.121, 0.140) 

Oak Valley Union Elementary (0.119, 0.135) 
South Pasadena Unified (0.116, 0.148) 
Brea-Olinda Unified (0.115, 0.032) 
Savanna Elementary (0.114, 0.149) 

Desert Sands Unified (0.113, 0.112) 
Corona-Norco Unified (0.113, 0.059) 
Covina-Valley Unified (0.112, 0.123) 

Fowler Unified (0.111, 0.229) 

Garden Grove Unified (0.110, 0.120) 
Huntington Beach City Elementary (0.109, 0.165) 
Central Union Elementary (0.109, 0.254) 
Ceres Unified (0.107, 0.064) 


82. 
83. 
84. 
85. 
86. 
87. 
88. 
89. 
90. 
91. 
92. 
93. 
94. 
95. 
96. 
97. 
98. 
99. 
100. 
101. 
102. 
103. 
104. 
105. 
106. 
107. 
108. 
109. 
110. 
111. 
112. 
113. 
114. 
115. 
116. 
117. 
118. 
119. 
120. 
121. 
122. 
123. 
124. 
125. 
126. 
127. 
128. 
129. 
130. 
131. 
132. 
133. 
134. 
135. 
136. 


Lakeport Unified (0.106, 0.033) 
Burlingame Elementary (0.105, 0.163) 
Waterford Unified (0.104, 0.135) 

Fountain Valley Elementary (0.102, 0.093) 
Long Beach Unified (0.101, 0.117) 

Selma Unified (0.101, 0.162) 

Snowline Joint Unified (0.099, 0.111) 
Mountain View Whisman (0.098, 0.288) 
Hart-Ransom Union Elementary (0.097, 0.016) 
William S. Hart Union High (0.096, 0.075) 
Los Altos Elementary (0.095, 0.083) 
Pioneer Union Elementary (0.094, 0.060) 
Imperial Unified (0.092, 0.148) 

Cypress Elementary (0.092, 0.042) 

Lemon Grove (0.092, 0.181) 

Keyes Union (0.091, 0.097) 

Central Elementary (0.090, 0.083) 

Bonita Unified (0.090, 0.077) 
Westminster (0.088, 0.250) 

Glendale Unified (0.087, 0.135) 

Lemoore Union Elementary (0.087, 0.056) 
San Bernardino City Unified (0.087, 0.092) 
Porterville Unified (0.087, 0.091) 

Chino Valley Unified (0.086, 0.054) 
Murrieta Valley Unified (0.085, 0.035) 

Red Bluff Union Elementary (0.083, 0.143) 
Tustin Unified (0.081, 0.008) 

Santee (0.074, 0.122) 

Gilroy Unified (0.072, 0.028) 

Moreland (0.072, 0.207) 

Visalia Unified (0.070, 0.115) 

El Centro Elementary (0.068, 0.049) 
Riverside Unified (0.066, 0.048) 
Tahoe-Truckee Unified (0.065, 0.020) 

Palo Alto Unified (0.065, 0.052) 

Colusa Unified (0.065, 0.053) 

Rowland Unified (0.064, 0.190) 

Lowell Joint (0.063, 0.145) 

Alvord Unified (0.063, 0.111) 

Galt Joint Union Elementary (0.063, 0.044) 
Alhambra Unified (0.057, 0.010) 

Santa Monica-Malibu Unified (0.055, 0.018) 
Beardsley Elementary (0.054, 0.050) 
McSwain Union Elementary (0.052, 0.036) 
Pleasanton Unified (0.050, 0.061) 

Arcadia Unified (0.049, 0.096) 

Albany City Unified (0.048, 0.028) 

Culver City Unified (0.047, 0.087) 

Salida Union Elementary (0.045, 0.041) 
Elk Grove Unified (0.045, 0.107) 

Alum Rock Union Elementary (0.043, 0.210) 
Lompoc Unified (0.043, 0.081) 

San Diego Unified (0.043, 0.142) 
Moorpark Unified (0.043, 0.078) 

Wilsona Elementary (0.041, 0.182) 
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District Name (Hispanic Student Residual, White Student Residual) 


137. San Ysidro Elementary (0.041, 0.186) 153. Bakersfield City (0.022, 0.081) 

138. Grossmont Union High (0.040, 0.012) 154. Palm Springs Unified (0.019, 0.009) 

139. Upland Unified (0.039, 0.031) 155. Orcutt Union Elementary (0.013, 0.051) 
140. Palmdale Elementary (0.038, 0.017) 156. Hacienda La Puente Unified (0.013, 0.054) 
141. Redding Elementary (0.036, 0.059) 157. Strathmore Union Elementary (0.013, 0.007) 
142. Empire Union Elementary (0.036, 0.025) 158. Milpitas Unified (0.009, 0.184) 

143. La Mesa-Spring Valley (0.035, 0.120) 159. Norwalk-La Mirada Unified (0.009, 0.025) 
144. Golden Valley Unified (0.034, 0.061) 160. Robla Elementary (0.007, 0.198) 

145. Roseville City Elementary (0.032, 0.068) 161. Torrance Unified (0.005, 0.003) 

146. Rescue Union Elementary (0.030, 0.021) 162. Victor Elementary (0.005, 0.068) 

147. Fullerton Elementary (0.028, 0.030) 163. Sweetwater Union High (0.004, 0.034) 
148. Goleta Union Elementary (0.027, 0.130) 164. Ventura Unified (0.004, 0.095) 

149. Temecula Valley Unified (0.027, 0.037) 165. Livingston Union (0.004, 0.056) 

150. Pomona Unified (0.025, 0.074) 166. Fontana Unified (0.004, 0.054) 

151. Oceanside Unified (0.024, 0.100) 167. Taft City (0.003, 0.072) 


152. Placerville Union Elementary (0.023, 0.035) 


Data sources: California Department of Education. (n.d.). California Assessment of Student Performance and Progress (CAASPP) results. 
https://caaspp.cde.ca.gov (accessed 01/05/18); National Center for Education Statistics. (n.d.). Education demographic and geographic estimates. 
https://nces.ed.gov/ programs/edge (accessed 01/05/18). 
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